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ABSTRACT 

Ad influential statistics test recoaaends a Le^ene 
text for hoBogefjeity of variance. A recent note suggests that 
Levene's test is upwardly biased for snail saaples. Another report 
shows inflated Alpb.r estimates and low power. Neither study utilized 
more than two saaple sizes. This Honte Carlo study involved saapling 
froB a noraal population for all conbinations of two to seven 
variances and equal saaple sizes froa three to twelve. Alpha was 
upwardly biased for saaller saaple sizes; Alpha was upwardly biased 
for increasing numbers of variances and fixed sample sizes. The 
Levene technique apparently has little to recoaaend it besides 
computational siaplicity. (Author) 
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AESTW.CT 

An Influential statistics text recomoends a Levene text for homogeneity 
of variance* A recent note suggeots that Levene test is upwardly biased 
for small samples* Another report shows inflated OC estimates and low power. 
Neither study utilized more than two sample sizes. This Monte Carlo study 
involved sampling from a normal population for all combinations of two to 
seven variances and equal sample sizes from three to twelve. Alpha was up- 
wardly biased for smaller sample sizes; a was upwardly biased for increasing 
numbers of variances and fixed sample sixes • The Levene technique apparently 
has little to recomraend it besides cca?pulatlona.\ sin^pllcity. 
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A recently 'ubllshed and highly regarded educational statistics text 
(Glass and Stanley, 1970) recommends, with little qualification, the uie of 
a Levene test (1960) for honogsneity of variance • Orginally the Levene test 
was popularized for educational researchers hy Glass (1966). Briefly, the 
portlcular Levene test advocated by Glass and Stanley (197G) and Glass (1966) 
Involves an analysis cf variance using as data the absolute values of the 
deviation scores, where the deviation scores are deviations from the column 
means (Levene recommended several other versions of this test, all involving 
an analysis €)f variance on a monotorlcally Increasing function of the deviation 
scores) • 

Although Glass and Stanley (1970) do state that the robustne^»a of the 
Levene technique has been demonstrated only "for equal numbers of ^observations 
in samples", they nevertheless give the impression that the test is a 
statistically desirable substitute for more standard tests such as BartIett*S| 
Scheffe's, Cochran's, and Hartley's. Is this impression correct? 

In the original exposition, Lev^ine (1960) reported the results of Monte 
Carlo studies based upon several ccmblnatiwas of equal sized samples {tO 
and number of groups (J)« When the sample siza la each level was relatively 
large (ni » 10 and n ■ 20) and the number of levels small (J * 2 and J. " 3)f the 
empirical probabilities of Type 1 error were quite close to the nom'inal values 
of a» Even with Levene's data, however, when J « 10 and n « 20* the empirical 
probability was «063 at the nominal .05 level. 
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After vhat «ome ml^.ht consider an inordinate lag, several theoretical 
ax\^ esipirlcril studies on the levene technique have been published. In a 
letter to the editor of TfichnQ*nem< Miller (1972) reported a small acale 
Monte Carlo study of the Levene test for three different distributions. In 
eaKpling from a normal distribution with J * 2 (apparently) and n • 3 and a • 4» 
Miller found inflated ratios of E(S^ ) to ECS^^). Miller's implicit conclusion 
was thcit Levene* 8 test probably vas inappropriate for small ii'ot 

Games et al. (1972) reported a comiiarattve study of several homogeneity of 
variance tests, also Ussing Monte Carlo techniques. For one combination (J[ " 3, 
n » 6) and a variety of distributions > GaTnes et al , (1972) found Inflated 
empirical alpha values for the Levene test- Moreover, the power of the Levene 
test war; low. Incidentally » both Games et aj.. (1972) and Miller (1972) seem 
to attribute part of the problem with the Levene tect to the dependence of 
observations within each coluran- 

Miller (1968) demonstrated that the Levane test Is not asymptotically 
distribution free, that is, things don*t necessarily get better as n increases* 

Taken together, the studies by Miller (1968,1972)» and Gaines et al, (1972) 
otlli do not constitute a needed overkill of the Levene technique. First, 
this failure stems iron a paucity of investigations, concerning the technique, 
over a wide range of sample sizes and number of variances when a normal 
dlatrlbutlon la assumed. If, Incleed^ th^-* statistical properties are inadequate 
for normal distribution,^, Investigations using non-nonrial distributions are 
merely of academic Interest. Second, this failure results from none of 
the reviewed studies employing more than two comblnacionc of saorple sizea 
and number of variances tested. Thus, any trends in power or algnlflcance 
level could not be detected by these atudiaa. 

This note aunmarlzes the results of a fairly extensive Monte Carlo atudy. 
(All programming waa done by the senior author). Tlie extent of this study 
Y_lnvolved examining the Levene technique for all cdabinations of two to seven 
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TABLE 1 

Observed Number of Type 1 Errors In 
10,000 Teetft, Given a Nominal 
Level of .05 



:ibcr of Variances (J) f^smplc Size (a ) 



3 4 5 6 7 8 9 IC 11 12 



2 


525 


791 


746 


659 


640 


601 


614 


576 


562 


545 


3 


711 


879 


774 


737 


669 


604 


624 


518 


556 


524 


4 


1138 


959 


788 


781 


725 


597 


609 


583 


566 


5U 


5 


1243 


1135 


903 


710 


723 


610 


648 


614 


570 


507 


6 


1398 


1174 


934 


902 


747 


638 


634 


613 


717 


66: 


7 


1343 


1443 


1140 


1128 


367 


670 


798 


721 


674 


535 
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variances and equal sosiple f ize of three through twelve in a one-way ANOVA 

frasiework. At = ach coribinatlon, 10>0CO sample F'a were creating using 

« n;. inal population. To create each sample > pfiuedo-random nuinbers were generated 

u: ng i he i) Itlplicatlve congruentlal method, and these were then transformed 

to standard nornal "ariateo (For & detailed discussion of the technique 

see Kaylor et^ .al^. , 1956, Pp. '>! ^ 95) < Ibece standard normal variates were 

th' ' placed in an analysis of vari.^nce franevork. For example, with J. * 3 

and n * 5> fifteen standard nornial deviates were generated and placed in three 

gtouiis of J each. The Levene teat vab then applied to test the homogeneity of 

variance oL the three groups or levels. The resultir.j^ F was one of the 10»000 

F*9 generated at this r ^^n^Linacion of J^«3 and £ 

Since 10,000 samples were selected in h case, the expected number of F's 
significant :t the vo v^^l is 500. The obtained number of F'e significant at 
the .05 level Is reported in TaMe 1. 

In a 11^ instancLs the Levene technique produced upwardly biased a esti- 
mates. Two interacting i ends seem dlgcernable in this upward bias: (a) For 
smaller n (roughly, n less * han 9), tr'- bias increases as the number of varl- 
ancca tested iricreases; (b) ! i larger ri, the bias seems to remain constant or 
even to fall as the number of v^rlarces increased. As would be expected In a 
sampling study, there are e f^w minor anomalies in the data but none which 
enaentlal^y detracts frort; our conclusions. Overall, the results of our study 
bear out the theorerlcal speculations of Miller (1968) and support the Monte 
Carlo studies of Miller (1972) and of Canics et al . (1972) • Kot only have we 
supported their studies, but by covering a wide range of sample sizes and 
number of variances we have provided additional data on the upwardly biased 
a level of the statietxc. Since the Levene technique seems to have little 
to offer the educational researcher except coroptitatioaal slQpllclty> its 
use should be discouraged. , 
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